Subject	nobody pays attention to robots.txt anymore
Posted by	Dallas DamonZ on August 31, 2025 at 12:59 AM
	This message has been viewed 26 times.
In Reply To	Re: LLM crawlers we don't have a defense for. posted by zquikone on August 29, 2025 at 11:32 PM
Message	that was an honor system thing. the crawlers don't even announce themselves as anything specific anymore to block them. it's difficult to distinguish between an actual user and a bot on the surface. Later When was the last time you *really* did something with your Z to call yourself a Z enthusiast? Member #1 PETZ
Follow Ups	Just an observation... - Zeus 11:10:27 08/26/25 I saw that too - Polishzx 14:18:59 08/26/25 I wonder if an AI would know where's ash? (n/m) - zantar 18:36:25 08/26/25 ba-DUM! *tish* (n/m) - vorpalZed 15:50:03 08/27/25 LLM crawlers we don't have a defense for. - Dallas DamonZ 17:11:19 08/26/25 Got it. Thanks for the insight, Damon. (n/m) - Zeus 08:58:35 08/28/25 If it ever becomes overly burdensome from a cost standpoint - Zeus 10:29:34 08/28/25 Re: If it ever becomes overly burdensome from a cost standpoint - nate91Z 10:05:46 08/29/25 Re: LLM crawlers we don't have a defense for. - zquikone 23:32:38 08/29/25 nobody pays attention to robots.txt anymore - Dallas DamonZ 00:59:56 08/31/25
Post a Followup	You cannot reply to this message because you are not logged in.